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I.  Problem 


Ten  years  ago  the  use  of  simulation  games  in  schools  was  practi- 
cally unheard  of;  today  hundreds  of  teachers  all  over  the  country  are 
employing  simulation  games  in  their  classrooms.  New  simulation  games 
are  being  developed  at  a very  rapid  pace  to  meet  this  demand.  Unfor- 
tunately, research  regarding  the  benefits  of  such  games  has  not 
advanced  nearly  as  rapidly  (Boocock  and  Schild,  1968;  Fletcher,  1971a; 
Greenlaw  and  Wyman,  1973).  This  report  is  an  attempt  to  summarize  and 
evaluate  the  results  and  the  quality  of  the  research  that  has  been  con- 
ducted. 

Definitions  of  "game"  are  many  and  varied.  Fletcher's  (1971a)  de- 
finition, which  lists  the  following  characteristics,  is  quite  adequate 
in  terms  of  the  context  of  this  paper: 

1.  there  is  a set  of  players 

2.  there  is  a set  of  rules  telling  what  the  players  are  permitted 
and  forbidden  to  do  during  the  game 

3.  each  player  has  a certain  capacity  to  act  (determined  by  the 
amount  of  resources  and  information  given  to  him) 

4.  there  is  a set  of  possible  outcomes  (goals)  which  are  specified 
or  determinable. 

Simulation  games  are  a subset  of  the  set  "games."  In  addition  to 
having  the  characteristics  described  above,  simulation  games  are  an 
abstraction  or  representation  of  some  aspect  of  the  real  world  (Barton, 
1970)  . Simulation  games  deal  with  such  diverse  topics  as  the  generation 
gap,  the  ecological  balance,  the  Civil  War,  the  Cold  War,  consumer 
credit,  and  politics. 
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II.  Research  Results 

Most  of  the  simulation  games  research  has  examined  the  effects  of 
games  on  one  or  more  of  the  following  variables:  (1)  interest,  (2)  at- 
titudes, (3)  feeling  of  efficacy,  (4)  knowledge,  and  (5)  intellectual 
skills.  Findings  regarding  the  effects  of  simulation  games  on  each  of 
these  variables  are  discussed  below. 

Interest 

It  is  frequently  maintained  that  simulation  games  arouse  student 
interest  to  a greater  extent  than  do  conventional  teaching  methods 
(Cherryholmes , 1966;  Heitzmann,  1974;  Livingston,  Fennessey,  Coleman, 
Edwards,  and  Kidder,  1973).  The  results  of  a number  of  studies  do 
indicate  high  student  interest  in  participating  in  simulation  games 
(Chartier,  1972;  Cohen,  1969,  Cohen,  1970;  Fletcher,  1971b;  Lee  & 
O'Leary,  1971).  However,  the  results  of  many  studies  indicate  that 
student  interest  in  the  subject  matter  represented  in  a simulation  game 
is  not  increased  by  participating  in  the  game  CBoseman  and  Schellenber- 
ger,  1974;  Livingston,  1970a;  Livingston,  1970b;  Livingston,  1971a). 
Edwards  (1971b)  is  one  of  the  few  to  have  found  that  a simulation  game 
increases  student  interest  in  the  subject  matter  the  game  represents. 
Raia  (1966)  reached  a similar  conclusion,  but  the  results  of  his  study 
can  also  be  interpreted  as  indicating  that  student  interest  was  not 
affected  (Boseman  and  Schellenberger,  1974).  Based  on  the  results  of 
the  studies  discussed  above,  assertions  that  simulation  games  are  effec- 
tive interest-arousing  devices  should  be  qualified.  Interest  is  usually 
aroused  in  the  simulation  games  themselves,  but  not  necessarily  in  the 
subject  matter  the  games  represent. 

Attitudes 


Many  studies  have  been  conducted  to  determine  the  effects  of  a 
simulation  game  on  attitudes  toward  the  subject  matter  represented  in 
the  game.  Perhaps  the  most  consistent  finding  is  that  students  who  play 
the  simulation  game  Democracy  will  become  more  tolerant  of  political 
"log  rolling,"  i.e.,  exchange  of  support  by  legislators  (Livingston, 
1971a;  Livingston,  1972;  Livingston  and  Kidder,  1972).  However,  Boocock 
(1968)  found  that  participation  in  the  Democracy  game  does  not  change 
attitudes  toward  legislators. 


Studies  examining  the  effects  of  participating  in  the  simulation 
game  Ghetto  have  not  produced  any  conclusive  results.  The  results  of 
two  studies  (Kidder,  1971;  Kidder  and  Aubertine,  1972)  indicated  that 
participation  in  the  Ghetto  game  did  not  have  an  effect  on  student  atti- 
tudes toward  ghetto  residents.  However,  other  studies  indicated  that 
attitudes  toward  ghetto  residents  were  improved  by  participation  in  the 
Ghetto  game  (Livingston,  1970a;  Livingston,  1971b).  One  of  the  studies 
cited  above  (Livingston,  1971b)  also  was  designed  to  determine  whether 
attitude  changes  toward  ghetto  residents  would  persist  over  long  periods 
of  time.  The  results  of  the  study  indicated  that  after  one  week  the 
Ghetto  game  did  not  have  any  effect  on  attitudes . 
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The  conflicting  results  of  the  studies  cited  above  are  indicative 
of  the  general  pattern  of  findings  regarding  the  effects  of  simulation 
games  on  participants'  attitudes.  In  some  instances  the  results  indi- 
cate simulation  games  affect  attitudes,  while  in  other  instances  the 
results  indicate  attitudes  are  not  affected.  The  findings  have  no 
apparent  pattern. 

Feeling  of  Efficacy 

The  results  of  a 1966  survey  of  education  in  the  United  States 
(Campbell,  Coleman,  and  Mood,  1966)  indicated  that  an  individual's  suc- 
cess in  school  was  strongly  related  to  his  feeling  of  efficacy — his 
belief  in  his  ability  to  control  his  own  destiny.  Since  the  release  of 
the  survey,  many  simulation  researchers  have  conducted  studies  examining 
the  effects  of  the  Democracy  game  on  participants'  feelings  of  political 
efficacy.  Results  of  these  studies  have  varied  considerably.  In  a 
study  conducted  by  Livingston  (1971a),  students'  feelings  of  political 
efficacy  were  significantly  higher  after  they  played  the  game  than  they 
were  before  they  played  the  game.  The  results  of  a study  by  Boocock 
(1968)  also  indicated  that  participation  in  the  Democracy  game  increased 
students'  feelings  of  political  efficacy.  However,  the  results  of 
three  studies  (Boocock,  Schild,  and  Stoll,  1967;  Livingston,  1971a; 
Livingston,  1972)  indicated  that  participation  in  the  Democracy  game  did 
not  have  an  effect  on  feelings  of  political  efficacy.  Furthermore,  the 
results  of  another  study  (Livingston  and  Kidder,  1972)  indicated  that 
the  Democracy  game  had  a slightly  negative  effect. 

Two  other  studies,  employing  different  games,  have  examined  the 
effects  of  games  on  feelings  of  political  efficacy.  In  one  study  (Vogel, 
1973) » students  who  had  participated  in  the  Metro  Government  game  had 
significantly  higher  feelings  of  political  efficacy  than  students  who 
had  received  traditional  instruction.  However,  in  another  study  (Alley 
and  Gladhart,  1975) , participation  in  the  Mayoral  Election  Game  did  not 
have  a significant  effect  on  students’  feelings  of  political  efficacy. 

Researchers  have  also  examined  the  effects  of  simulation  game  par- 
ticipation on  feelings  of  efficacy  in  areas  other  than  politics. 

Edwards  (1971b)  found  that  participation  in  a business  game  increased 
feelings  of  efficacy,  while  Boocock  et  al.  (1967)  found  that  feelings 
of  efficacy  were  not  affected  by  participation  in  a career  decisions 
game.  Just  as  in  the  area  of  political  efficacy,  these  results  are  in- 
conclusive. In  general,  the  research  findings  do  not  enable  us  to  state 
what  effect  simulation  games  will  have  on  a participant's  feeling  of. 
efficacy. 

Knowledge 

Knowledge  has  been  defined  as  the  recall  of  ideas  or  phenomena 
(Bloom,  Engelhart,  Furst,  Hill,  and  Krathwohl,  1956).  Many  studies  have 
been  designed  to  examine  the  effects  of  simulation  games  on  student 
acquisition  of  knowledge.  The  studies  often  involve  a conq>arison  of  the 
effects  of  simulation  games  and  traditional  instruction.  The  results  of 
most  of  the  studies  of  this  type  indicate  that  students  acquire  approxi- 
mately the  same  amount  of  knowledge  in  a simulation  game  as  they  do  in 
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traditional  instruction  (Anderson,  1970;  Boocock  et  al.,  1967;  Chartier, 
1972;  Fennessey,  Livingston,  Edwards,  Kidder,  and  Nafziger,  1972). 

There  have  been  only  a few  exceptions  to  this  finding.  The  results  of 
one  portion  of  a study  cited  above  (Boocock  et  al.,  1967)  indicated  that 
students  taught  by  traditional  methods  acquired  more  knowledge  than 
students  who  had  participated  in  a simulation  game.  Conversely,  Baker 
(1968)  found  that  students  who  participated  in  a simulation  game 
acquired  significantly  more  knowledge  than  students  who  received  tradi- 
tional instruction.  Fletcher  (1970) , however,  has  raised  some  serious 
questions  about  the  validity  of  Baker's  study. 

Other  than  the  findings  reported  by  Baker,  the  findings  regarding 
the  effects  of  simulation  games  on  the  acquisition  of  knowledge  have  not 
been  impressive.  In  a few  instances  (Boocock,  1968;  Fletcher,  1971; 
Livingston,  1971c),  student  participation  in  a simulation  game  has  had 
a positive  effect,  but  in  each  case  the  magnitude  of  the  effect  has  been 
rather  small.  In  addition  there  have  been  other  instances  where  student 
participation  in  a simulation  game  has  not  resulted  in  any  increase  in 
student  acquisition  of  knowledge  (Livingston,  1970a;  Livingston,  1970b). 
These  results  indicate  that,  in  general,  student  knowledge  is  not  signi- 
ficantly affected  by  participation  in  a simulation  game. 

Intellectual  Skills 

According  to  Bloom  et  al.  (1956),  intellectual  skills  refer  to  an 
individual's  ability  to  apply  knowledge  to  new  problems.  Researchers 
studying  the  effects  of  simulation  games  have  often  examined  students' 
ability  to  perform  tasks  of  this  type. 

Many  of  the  studies  which  have  examined  the  effects  of  simulation 
games  on  intellectual  skills  have  been  in  the  field  of  business. 

McKenney  (1962)  found  that  student  participation  in  a simulation  game 
had  a positive  effect  on  ability  to  analyze  a given  business  situation 
and  make  appropriate  planning  decisions.  Raia  (1966)  obtained  similar 
results.  However,  Boseman  and  Schellenberger  (1974)  found  that  simula- 
tion game  participation  did  not  have  a significant  effect  on  student 
ability  to  analyze  a given  business  situation.  Similarly,  Livingson 
(1971c)  found  that  participation  in  a business  simulation  game  did  not 
have  a significant  effect  on  ability  to  evaluate  given  business  deci- 
sions . 

A number  of  other  studies  (Anderson,  1970;  Chartier,  1972;  Fennessey 
et  al.,  1972;  Karweit  and  Livingston,  1969)  indicate  that  simulation 
games  do  not  have  a significant  effect  on  intellectual  skills.  Kidder 
and  Guthrie  (1971)  did  find  that  participation  in  a simulation  games  de- 
signed to  teach  behavior  modification  skills  had  a significant  effect  on 
the  frequency  with  which  students  used  positive  reinforcement  in  a 
tutoring  situation.  However,  they  also  found  that  participation  in  the 
game  did  not  affect  student  ability  to  select  behavior  modification 
solutions  to  hypothetical  problem  situations. 

A type  of  intellectual  skill  that  was  not  examined  in  the  studies 
cited  above  is  a participant's  performance  in  a simulation  game.  The 
results  of  a few  studies  indicated  that  performance  in  a simulation  game 
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can  be  improved  by  repeated  participation  in  the  game  (Fletcher,  1971; 
Schild,  1968).  Edwards  (1971a),  however,  found  that  student  performance 
in  a simulation  game  does  not  improve  after  the  second  time  the  game  is 
p layed . 

The  results  of  the  studies  examining  the  effects  of  simulation 
games  on  intellectual  skills  are  ambiguous.  It  appears  that  participa- 
tion in  a simulation  game  can  have  a significant  effect  on  intellectual 
skills,  but  this  is  not  a frequent  occurrence.  The  skill  most  likely 
to  be  affected  by  game  participation  is  the  ability  to  play  the  game. 

Summary 

The  results  of  the  research  conducted  with  simulation  games  in 
education  are,  for  the  most  part,  not  very  positive.  This  is  especially 
true  with  regard  to  the  effects  of  simulation  games  in  the  cognitive 
domain.  Results  indicate  that  simulation  games  rarely  have  a significant 
effect  on  the  acquisition  of  knowlege,  and  usually  do  not  have  a signi- 
ficant effect  on  intellectual  skills.  The  intellectual  skill  most  likely 
to  be  affected  by  game  participation  is  the  ability  to  play  the  game. 

In  the  affective  domain,  there  is  no  apparent  pattern  to  the  effects 
simulation  games  have  on  feelings  of  efficacy  and  attitudes  toward  the 
subject  matter  represented  in  a game.  Studies  also  have  indicated  that 
students  are  interested  in  participating  in  simulation  games,  but  that 
the  simulation  games  do  not  necessarily  arouse  student  interest  in  the 
subject  matter  the  games  represent.  Taken  as  a whole,  these  results  do 
not  indicate  that  simulation  games  are  a highly  effective  instructional 
device . 


III.  Research  Methods 


If,  as  the  previous  section  of  this  paper  indicates,  the  results 
of  simulation  games  research  are  not  very  positive,  then  the  fault  lies, 
in  part,  with  the  research  methods  employed.  One  problem  has  been  that 
simulation  games'  researchers  have  had  difficulty  determining  what  de- 
pendent variables  to  examine  (Fletcher,  1971a).  Unfortunately,  simula- 
tion games  are  rarely  accompanied  by  materials  which  describe  the 
objectives  of  the  game  (Boseman  and  Schellenberger , 1974).  Even  when 
objectives  are  stated,  they  are  usually  stated  in  non-behavioral  terms. 
Thus,  those  who  attempt  to  evaluate  a game's  effectiveness  must  infer 
what  behaviors  can  be  acquired  by  a student  who  plays  the  game.  It 
seems  likely  that  some  researchers  have  measured  behaviors  a game  could 
not  teach  and  have  failed  to  measure  behaviors  that  were  taught. 

Simulation  games  should  be  designed  to  enable  students  to  attain 
specific  behavioral  objectives  and  lists  of  those  objectives  should  be 
included  with  the  games.  The  specification  of  a simulation  game's 
objectives  would  help  researchers  determine  what  dependent  variables 
they  should  examine.  Furthermore,  if  the  objectives  were  specified  be- 
fore a game  was  designed,  the  design  procedure  might  be  more  systematic 
and  might  result  in  a more  effective  game. 

In  simulation  games  research,  the  effectiveness  of  a game  is  deter- 
mined, of  course,  by  measuring  some  dependent  variables.  However, 
dependent  variables  are  not  labelled  uniformly  in  the  research  literature. 
In  some  instances  different  terms  are  used  to  describe  the  same  behavior. 
For  example,  what  has  been  called  "intellectural  learning"  in  one  study 
(Boocock,  1968)  has  been  called  "attitude"  in  another  study  (Cohen,  1969). 
In  other  instances  the  same  term  has  been  used  to  describe  different  be- 
haviors. For  example,  Edwards  (1971b)  discussed  "motivation"  in  terms 
of  student  interest  in  a course  and  the  amount  of  work  students  did  in 
the  course,  whereas  Cohen  (1970)  discussed  "motiviation"  in  terms  of 
student  interest  in  a game  and  student  school  attendance  records.  Termi- 
nology differences  such  as  these  are  commonly  found  in  the  research 
literature  and  make  it  difficult  to  draw  general  conclusions  from  the  re- 
search. In  the  future,  simulation  games'  researchers  should  define  more 
precisely  the  dependent  variables  they  examine,  making  certain  that  the 
definitions  they  use  are  consistent  with  definitions  used  in  other 
studies . 

Just  as  there  are  problems  with  the  dependent  variables  examined  in 
simulations  research,  there  also  are  problems  with  the  independent  vari- 
ables examined.  Many  of  the  simulation  games  studies  involve  comparisons 
between  simulation  games  and  other  forms  of  instruction.  Unfortunately, 
these  studies  do  not  contribute  much  to  our  understanding  of  what  can, 
or  does,  make  simulation  games  effective  teaching  devices.  More  studies 
should  be  designed  to  examine  those  variables  which  might  contribute  to 
the  effectiveness  of  simulation  games.  The  findings  of  studies  of  this 
type  would  help  game  designers  develop  more  effective  games. 

One  of  the  conditions  necessary  for  experimentally  determining  the 
effectiveness  of  simulation  games  is  that  confounding  factors  are 
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present  in  the  studies  that  are  conducted.  This  brings  us  to  another 
problem  associated  with  simulation  games  research — the  use  of  non- game 
activities  before,  during,  and  after  a game.  Orientation  prior  to  a 
game,  coaching  during  a game,  and  discussion  after  a game  are  often  con- 
sidered to  be  part  of  the  game  treatment  (for  example,  see  Livingston, 
1971c;  Kidder  and  Guthrie,  1971).  However,  these  non-game  activities 
may  have  effects  which  are  independent  of  the  effects  of  a game.  Thus, 
in  order  to  prevent  a confounding  of  effects,  non-game  activities  should 
not  be  included  as  part  of  a treatment,  unless  such  an  activity  is  being 
studied  as  an  independent  variable. 

The  problems  discussed  above,  while  not  inclusive,  represent  some 
of  the  major  problems  associated  with  simulation  games  research.  In 
summary,  the  authors  suggest  that  in  order  to  overcome  these  problems 
researchers  should: 

1.  examine  as  independent  variables  those  factors  which  might  con- 
tribute to  the  effectiveness  of  simulation  games 

2.  exclude  non-game  activities  from  the  various  treatments,  unless 
such  an  activity  is  being  examined  as  an  independent  variable 

3.  identify  some  appropriate  dependent  variables  to  measure 

4.  be  consistent,  across  studies,  in  the  terminology  used  to  de- 
scribe the  studies . 
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IV.  Conclusions 


As  the  first  portion  of  this  paper  indicated,  the  use  of  simulation 
games  has  not  been  demonstrated  to  be  a highly  effective  instructional 
method.  Perhaps  this  is  due  to  some  of  the  problems  with  simulation 
games  research  methods.  Or  perhaps  simulation  games  are  not  the  highly 
effective  Instructional  devices  much  of  the  early  literature  on  simula- 
tion games  proclaimed  them  to  be.  Or  perhaps,  as  the  authors  of  this 
paper  believe,  it  is  a bit  of  both— neither  the  research  methods  nor  the 
simulation  games  are  as  good  as  they  should  and  can  be. 
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